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Abstract 

A Monte Carlo Renormalization Group algorithm is used on the Ising 
model to derive critical exponents and the critical temperature. The algo- 
rithm is based on a minimum relative entropy iteration developed previ- 
ously to derive potentials from equilibrium configurations. This previous 
algorithm is modified to derive useful information in an RG iteration. The 
method is applied in several dimensions with limited success. Required 
accuracy has not been achieved, but the method is interesting. 

Introduction 

Monte Carlo Renormalization Group has been used with much success for over 
twenty-five years. The Large Cell Renormalization method calculates the renor- 
malized parameters by renormalizing the system to a two spin system which 
can be solved exactly. Swendsen's method avoids calculating the renormailizcd 
parameters by using a Taylor expansion of the Renormalization operator. Cal- 
culating several variances leads to a determination of the eigenvalues of the 
operator jSJ 0]. Ma's method calculates the parameters in the Renormal- 
ized Hamiltonian using an analysis of the Monte Carlo dynamics 0] In 
our method, the parameters of the Renormalized Hamiltonian are derived us- 
ing a minimum relative entropy iteration. The number of coupling parameters 
is controlled and error in the method can be estimated using usual statisti- 
cal methods. The eigenvalues of the operator can be determined directly from 
the Renormalized Hamiltonian. This also allows the critical temperature to be 
directly calculated. Higher order coupling parameters can be included for an 
estimate of their effect. 



Our Method 

The following is based largely on an algorithm originally developed by reference 
The method is based on the following assumptions. The system is assumed 
to be in thermodynamic equilibrium and the energy can be written as a sum 
of terms which are products of parameters and functions of the configuration. 
E(F,P) = ^2- Pi * hi(T) = P ■ H where T represents the configuration of the 
system(s). P = {pi} represents the set of parameters to be derived. In the 
case of the Ising Model, E = — JJ2<ij> s i ' s j ~ KJ2i s i- ^ n our notation, 

hi = S<ij> S i ' S j > Pi = - J J h 2 = J2i S i and P-2 = ~K. 
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The probability of a configuration, given parameters, is given by the Boltz- 
mann distribution Prob{T\P) = e -E{r,P)/kT j z = e (-E(T,P)+F(P))/kT where 

Z (P) = T,r Ex P(-P E ( T 'P)) and F (P) = -kT\n(Z(P)). 

If we are given the exact equilibrium conformation, T* , the maximum likeli- 
hood of parameter values are those values for which the probability, Prob(T* \P) 
is a maximum wrt P. Maximizing an exponential corresponds to maximizing the 
argument (ignoring the multiplicative constant (3), —E(T*,P) +F(P) = Q(P). 
This also corresponds to extremizing the entropy TS = E — F. 

Our method is basically the multi-dimensional form of Newton's method for 
optimizing functions. Maximizing Q(P), Newton's Method is 

P k+1 = P k - D 2 (Q(P k ))- 1 ■ D{Q(P k )) (1) 

where (D 2 ) -1 represents the inverse Hessian matrix and D represents the gra- 
dient. In practice this is modified slightly, 

pk+i = pk + g ( A p) 

where the use of e < 1 corresponds to the "Damped Newton's Method". 

Maximizing Q = —E + F wrt P using statistical mechanical definitions leads 
to the following 

D(Q) t = -h*+ <hi> (3) 

D 2 (Q)ij = p(< hi >< hj > - < Khj >) = -(3Cov(hi,hj) (4) 

Resulting in the following iterative equation where VCM(H) is the variance- 
covariance matrix of H 

AP = kT * VCM(H)- 1 ■ (< H > -Fl*) (5) 

The method is easily generalized to a distribution of equilibrium configurations. 

AP = kT* VCM(H)- 1 •(<#>- <H > Prob{ r)) (6) 

< ... > represents a Boltzmann average and < ... >p ro b(r) represents an average 
over the given distribution. 

Renormalization 

Renormalization can be described as an operator acting on the original Hamil- 
tonian to create a Renormalized Hamiltonian. Linearizing the operator near 
the fixed point, relevent eigenvalues can be isolated. By examining the plot of 
renormalized vs original parameters, the eigenvalues can be determined. The 
eigenvalues Aj, correspond to the slope of these lines. With the usual approx- 
imations, the exponents can be calculated , Vi = ln(6)/ln(Ai) 0]. The critical 
temperature can be determined by calculating the intersection of the derived 
thermal coupling parameters and the line y=x. Flow diagams could easily be 
extracted, although they are not done in this study. 
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Using Renormalization notation, the reduced hamiltonian for the Ising model 
is given below. 

H r = —H/kT (7) 

H r = KftljSi + KiY] nn SiSj + K2^nnn s iSj + K4Yl square SiSjSkSl + ... (8) 

Applying the algorithm to Renormalization requires an outer iteration over a 
parameter (ie K+ for some i) while other parameters remain fixed. 

The original system(s) is brought to equilibrium at some fixed values for all 
parameters. The renormalized system(s) is created from this original system. 
The above iteration represented by equations 1,2 and 5 can be carried out on 
large number of lattices simultaneously to determine what values of parameters 
would lead to this renormalized system. As a parameter is varied the corre- 
sponding eigenvalues and critical exponents can be derived. The method is 
simpler to apply if the renormalization method is not a quasi-linear method 
Majority rule renormalization is used in all of the following. 

2-D Ising Model 

The algorithm was attempted on a 2-D Ising model. Exponents and critical 
temperature are known from the original solution by Onsager 
v = 1 , 6 = 8/15 and T crMcal = 2.269 

2D Ising Model Thermal Coupling Exponent 

The thermal eigenvalue can be determined by varying the ratio of J/kT through 
the critical value at zero field. The corresponding exponent, in terms of corre- 
lation length and reduced temperature, is 

£cxi*r (9) 

The renormalized parameters were calculated as per the above algorithm. Figure 
1 shows several runs of various lattice sizes and number. The slopes, exponents 
and critical temperatures are shown in table 1. 



Size 


Slope 


v = In 2/ hi(slope) 


Intercept 


^critical 


8 


1.96 ±0.04 


1.03 ±0.03 


0.43 ±0.02 


2.23 ±0.14 


16 


1.99 ±0.02 


1.01 ±0.01 


0.44 ±0.01 


2.25 ±0.07 


32 


2.02 ±0.03 


0.99 ±0.02 


0.45 ±0.01 


2.27 ±0.08 


32 (W) 


1.95 ±0.01 


1.03 ±0.01 


0.42 ±0.01 


2.26 ±0.06 


64(W) 


1.98 ±0.02 


1.01 ±0.02 


0.43 ±0.01 


2.28 ±0.07 



Table 1: Calculation of 2-D Ising model thermal coupling exponent. Exact value 
is v = 1 and T crltlC ai = 2.269 
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Figure 1: Plot of Rcnormalizcd parameter K[ (Y-axis) vs K\ (X-axis) for 2-D 
Ising model. Intersection of the line y=x with the data corresponds to the fixed 
point. Error bars arc included on the plot but arc on the scale of the size of the 
points. 
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Magnetic eigenvalue 



The other exponent and eigenvalue can be determined by fixing J/kT at ap- 
proximately the critical value and varying the field parameter through zero. 
The corresponding exponent, in terms of correlation length and field, is 

a*\K\- e (io) 

K represents the external field. The renormalized parameters were calculated as 
per the above algorithm. Figure 2 shows data runs over a large variation in field 
parameter. The critical region, near zero field, shows a more linear relationship 
as shown in figure 3. Least squares best fit to a straight line was done on this 
central region. The results are shown in table 2. 
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Figure 2: Plot of Renormalized magnetic parameter/kT (Y-axis) vs Original 
magnetic parameter/kT (X-axis) for 2-D fsing model near the critical tem- 
perature. 4000 MC steps per site were used. Data is from systems with 
a.)16x!6,n=1024 b.)8x8,n=1024. 



Size 


Slope 


6 = ln2/ln(A) 


8 


3.63 ±0.48 


0.54 ±0.06 


16 


3.68 ±0.16 


0.53 ±0.02 



Table 2: Calculation of magnetic exponent for 2-D Ising model. Exact value is 
61 = 8/15 = 0.53 
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Figure 3: Plot of Renormalized magnetic parametcr/kT (Y-axis) vs Original 
magnetic parameter/kT (X-axis) for 2-D Ising model near the critical temper- 
ature. 
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3D Ising Model Eigenvalues 



The algorithm was applied to the 3D and 4D Ising model with encouraging 
results, even on small lattice sizes. Approximate exponents for 3D are known 
from several sources. Reviews are given by references QJE]. 



Size 


Slope=a 


v = In 2/ hi(slope) 


Intercept=b 


Tcritical — (1 — a )/b 


4 


3.02 ±0.07 


0.63 ±0.01 


0.44 ±0.02 


4.59 ±0.17 


32 


3.40 ± 0.09 


0.57 ±0.01 


0.53 ±0.02 


4.53 ±0.24 



Table 3: Calculation of thermal coupling exponent for 3-D Ising model. Ap- 
proximate value is v w 0.63 and T cr iucai ~ 4.52. 



Size 


Slope 


9 = hx2/]n{slope) 


4 


6.3 ±0.3 


0.38 ±0.01 



Table 4: Calculation of magnetic exponent for 3-D Ising model. Expected value 
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4D Ising Model - Mean Field Theory Exponents 



Size 


Slopc=a 


v = \n2/ \n(slope) 


Intcrccpt=b 


^critical (l 


-a)/b 


4 


4.3 ±0.1 


0.48 ±0.04 


0.48 ±0.02 


6.8f 


3 ±0.5 



Table 5: Calculation of thermal coupling exponent for 4-D Ising model. Exact 
values are v = 0.5 and T crit i ca i — 6.68. 



Size 


Slope 


e 


exact 


4 


10.2 ±0.8 


0.30 ±0.01 


0.333.. 



Table 6: Calculation of magnetic exponent for 4-D Ising model. Exact value is 
9 = 1/3. 
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Conclusion 



Much higher precision and accuracy is required to compare with current esti- 
mates of exponents, but the derived exponents match reasonably well with ex- 
pected values. Improvement is expected with larger lattices and more systems, 
perhaps with more clever averaging methods. The effect of critical slowing down 
has not been thouroughly investigated. The algorithm has several advantages 
over other algorithms. The number of coupling parameters is kept the same from 
original system to the renormalized system with minimum relative entropy de- 
rived values for the renormalized parameters. This seems more consistent than 
an arbitrary cutoff in parameter space. The renormalized parameters are di- 
rectly calculated, unlike other algorithms. By changing the parameter of the 
outer iteration, all exponents can be magnified and derived. If flow diagrams 
are desired, the algorithm could be easily modified to provide them. The error 
in the calculated exponents can be derived through usual statistical properties. 
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